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Abstract — It is shown that a trellis realization can be locally 
reduced if it is not state-trim, branch-trim, proper, observable, 
and controllable. These conditions are not sufficient for local 
irreducibility. Making use of notions that amount to "almost 
unobservability/uncontrollability", a necessary and sufficient cri- 
terion of local irreducibility for tail-biting trellises is presented. 



I. Introduction 

This paper deals with tail-biting trellis realizations for linear 
block codes. They form the simplest type of realizations on 
graphs with cycles. The latter have gained a lot of interest 
because they are often simpler than realizations on cycle-free 
graphs and thus may give rise to more powerful iterative de- 
coding algorithms (e.g., LDPC codes). Unfortunately, minimal 
realization theory turns out to be much more challenging for 
graphs with cycles than for graphs on a finite conventional 
time axis, see and the references therein, and even on 
general cycle-free graphs, see Q. The discussion in [7] nicely 
illustrates the difficulties for the special case of tail-biting 
trellis realizations. 

In this note we will study tail-biting trellis realizations 
with the goal to reduce their complexity by a local reduction 
process. We first present necessary criteria for local irreducibil- 
ity of such realizations. They amount to well-known basic 
trellis properties. Secondly, we give a sufficient criterion. This 
criterion is less obvious, and our approach will reveal how the 
normal graph dualization as derived in [1| helps to uncover 
defects of realizations that are otherwise not immediately 
evident. In fact, it turns out to be beneficial to investigate a 
trellis and its dual simultaneously. 

Finally, we will relate our results to the approach taken 
by Koetter and Vardy [7], who narrowed down the class 
of potentially minimal tail-biting trellises by making use of 
product constructions. 

We wish to mention that the results presented in Sec- 
tions [II] and [III] generalize straightforwardly to general normal 
graphs (5), 141. but it is open whether Section IV can be 
generalized as well. 



A linear block code C over a finite field F is a subspace of 
a symbol sequence space A = fl™^ 1 ^;, where each symbol 
alphabet Ai is a finite-dimensional vector space over F. 

A linear tail-biting trellis realization (for short: trellis) is 
a collection of state spaces Si and local constraint codes Ci 
such that all spaces are finite-dimensional over F and Ci C 
Si X Ai X <S,+i for all i G Z m := {0, . . . , m — 1} (with 
index computation modulo in). The state sequence space is 
defined as S — YYi^Q 1 $i> an d tne elements of Ci are called 
branches. The behavior of the realization is the set 03 of all 
pairs (a, s) G A x S such that all constraints are satisfied; 
i.e., (sj, aj, Sj +1 ) G Ci for all i. The code C generated by 
the realization is the set of all a G A that appear in some 
(a, s) G 03. Note that conventional trellis realizations may 
simply be regarded as the special case where Sq is trivial. 

A trellis realization of the code C is observable if for each 
a G C there is precisely one pair (a, s) G 03. The realization 
is state-trim (resp. branch-trim) if each state (resp. branch) 
appears on a valid trajectory. We say that a constraint code 
is trim if both the projections of Ci onto Si and onto <Sj+i 
are surjective. A constraint code C,; is proper if there are no 
nonzero branches of the form (sj,0, 0) or (0, 0, Sj+i) in Cj. 

Finally, we introduce the main concept of this note. 



Definition 1.1 A local reduction of a trellis is a replace- 
ment of one state space, say Si, and the incident constraint 
codes Cj_i and Ci by spaces of at most the same dimension 
while all other spaces remain unchanged such that the resulting 
trellis represents the same code. We call a local reduction strict 
if the state space dimension is strictly reduced. A realization is 
called locally irreducible if each local reduction is isomorphic 
to the primal realization. 

Obviously, if no dimension is reduced then the terminology 
"local reduction" is not quite justified, and "local alteration" 



We fix the following notations pertaining to tail-biting trellis 
realizations. 
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may be more appropriate. But we will see later (Theorem IV.4 1 
that a local reduction is always either strict or results in a 
trellis that allows a subsequent strict local reduction so that 
ultimately we achieve a net reduction of the trellis complexity. 

The main tools for locally reducing a trellis are the mutu- 
ally dual processes of trimming and merging. They will be 



discussed in Section III It will be shown that they allow us 
to reduce a trellis and its dual simultaneously. 



II. Duality 

We briefly recall the basic duality notions. 

If V is a finite-dimensional vector space over F, then its dual 
space V is defined to be the linear algebra dual of V. Thus 
we have an inner product on V x V. For a subspace W C V 
the orthogonal space W C V is defined as the space of 
all vectors in V that are orthogonal to all vectors in W. For 
further properties we refer to (TJ, 0. 

Following the normal graph dualization introduced in |[T), 
we define the dual of a trellis T as the trellis with the same 
index set in which the symbol alphabets Ai, Si are replaced by 
their dual spaces A\, Si, the constraint codes Ci are replaced 
by their orthogonal spaces Cf- C <Sj x A\ x iSj+i, and the 
sign of each dual state variable is inverted in one of the two 
constraints in which it is involved. The Normal Graph Duality 
Theorem U) states that if T realizes a linear code C, then its 
dual, denoted by T°, realizes the orthogonal code C . 

A main tool in dualization is projection/cross-section dual- 
ity, for which we refer to [1, Thm. 7.2] or J3] Sec. 2.5]. As a 
first application one obtains the following [6|, [3]. 

Theorem II.l The constraint code Ci of a trellis T is trim if 
and only if the dual constraint code ofT° is proper. 

We call a realization T controllable if the constraints 
Cj , i £ Z m , are linearly independent (in A x S). A detailed 
discussion and justification of this terminology can be found 
in [3 1, where also the following has been proved. 

Theorem II.2 A trellis T is controllable if and only if the dual 
trellis T° is observable. Moreover, T is controllable if and only 
if dim 93 = ^\ dimC; — dim S. 

Example II.3 This example appeared first in Q, (6). Fig- 
ure 1(a) shows the product trellis with symbol spaces Ai = F 2 
for i £ Z 4 , obtained from the generators OHIO, 10010, 01 101 
with the indicated circular spans. The dashed (resp. solid) 
lines denote symbol variable (resp. 1). The dual trellis is 
in Figure 1(b). Note that we chose Si = Si and the standard 
inner product for all state spaces and that no sign inverter is 
needed. Both trellises are state-trim, proper, observable and 
controllable. But the trellis in 1(b) is not branch-trim. We will 
see in the next section that both trellises are locally reducible. 




Figure 1(a) 
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Figure 1(b) 



III. Necessary Criteria for Local Irreducibility 

In this section we turn to local reductions of a given trellis. 
In essence, all constructions will amount to trimming (i.e., 
restricting) or merging (i.e., "quotienting") a particular state 
space. Thus, let us discuss these constructions in detail. 



Let T and T" be two trellis realizations of the code C with 
index set {0, ...,m — 1}. Denote the state spaces and con- 
straint codes by Si, Ci and 5|, respectively. We say that T" 
is obtained from T by trimming the state space Si, if S[ is a 
subspace of Si and C' i _ 1 = {(sj-i, Oj-i, Si) £ C;-i | Si £ S-} 
and C[ = {(si, ai, s i+ i) £ Ci | Sj £ S' { }, while all other state 
spaces and constraint codes of T and T' coincide. 

The dual of state-trimming is an instance of what is known 
as merging in the literature of trellis realizations. In our case, 
merging has to be done by taking a suitable quotient space in 
order to keep the linearity of the resulting trellis. Precisely, 
we say the realization T' is obtained from T by merging 
at time i if S[ = Si/y for some subspace y C Si and if 
= {{s l -i,a i -i,s l + y) I (si-i,ai-i,Si) £ CVi} and 
similarly C[ = {(si+y, a % , s i+1 ) \ (s l , a % , s i+1 ) £ Ci}. Again, 
all other state spaces and constraint codes of T" and T coin- 
cide. It follows from projection/cross-section duality that T' 
is obtained from T by trimming Si to the subspace y if and 
only if (T')° is obtained from T° by merging Si to Si/y- 1 . 

In general, the trimmed/merged realization generates a dif- 
ferent code than the original realization. We will, of course, 
be interested in the case where the code generated does not 
change after trimming/merging. In this case, trimming and 
merging obviously form simultaneous local reductions of the 
trellis and its dual in the sense of Definition |IT| 

Now we can present a first list of necessary conditions for 
local irreducibility. 

Theorem III.l Any locally irreducible realization is state- 
trim, proper, observable, and controllable. More precisely, if a 
realization T lacks any of these properties, then there exists a 
strict local reduction ofT, and the dual process is a strict local 
reduction of T° . 

Proof: If T is not state-trim or not proper, then we can 
trim either T or T° (see Theorem II.l 1. The dual process is a 
merging, and we obtain strict local reductions for T and T° . 
Next, suppose T is unobservable. Precisely, let (0, s) be a non- 
trivial unobservable trajectory and let Sj £ Si be a nonzero 
state on this trajectory. Let % be a subspace of 5, such that 
Ti © (sj) = S^ It is not hard to see (|3|) that the realization 
obtained by trimming Si to Ti still generates the same code. 
Thus we have obtained a strict local reduction. The dual 
process is a suitable state merging of T° , and this again is 
a strict local reduction. This also shows that uncontrollable 
realizations are locally reducible. ■ 

Note that the trellises in Figure 1 have all the necessary 
conditions of the previous theorem, and thus this simple test 
does not imply their local reducibility. In fact, we need to make 
use of the fact that the trellis in Figure 1(b) is not branch-trim. 

The following notion will be crucial for our further in- 
vestigation. It addresses non-branch-trimness in a way that 
is naturally dualizable. This will allow us to uncover the 
shortcomings of the trellis in Figure 1(a). 



Definition III.2 An observable and controllable trellis is 
called span-one-uncontrollable (resp. span-one-unobservable) 
if we can replace one constraint code by a proper subspace 
(resp. superspace) without changing the code realized by the 
trellis. 

Evidently, an observable and controllable trellis is span-one- 
uncontrollable if and only if it is not branch-trim. Moreover, a 
trellis T is span-one-uncontrollable if and only if its dual T° 
is span-one-unobservable. This follows immediately from the 
equivalence C Q O C t - D C^, which also shows that 
replacing a constraint code by a proper subspace or superspace 
are mutually dual processes. Furthermore, if T is span-one- 
uncontrollable, then a branch-trimming (i.e., replacing a con- 
straint code by a proper subcode) results in an uncontrollable 



trellis. This is a direct consequence of Theorem II. 2 Dually, a 
span-one-unobservable trellis will become unobservable after 
branch-addition (replacing a constraint code by a proper 
supercode). This explains the terminology. 

Now we can formulate another necessary condition for local 
irreducibility. 

Theorem III.3 Let T be span-one-unobservable. Then T al- 
lows a strict local reduction. The dual process is a strict local 
reduction of T°, and thus span-one-uncontrollable trellises are 
locally reducible as well. 

Proof: Let T be span-one-unobservable (but observable). 
Then T° is span-one-uncontrollable and we may replace a 
constraint code, say C^, by a strict subspace, say C^~, without 
changing the code generated by the realization. Without loss 
of g ener ality we may assume dimC^ = dimC^ 1 — 1. Theo- 



H.2 



shows that the resulting realization, denoted by T°, is 
uncontrollable. The dual process is the expansion of the con- 
straint code Ci to the superspace Ci where dimCi = dimCj+l, 
and by Theorem 
Thus by Theorem 



II.2 



III.l 



we obtain an unobservable realization T. 
the trellis T can be trimmed. We have 



to do this carefully in order to decrease the dimension of 
the enlarged constraint code Cj. Since T is observable, but 
T is not, there exists a nonzero branch (sj,0,Sj+i) <E Ci\Ci. 
Without loss of generality, let s$ 7^ and thus we may trim 



the state space Si as described in the proof of Theorem III. 1 



The resulting realization, denoted by T, has a strictly smaller 
state space and constraint code at time i than T. Hence the 
final constraint code dimensions of T are not larger than those 
of T, and we have performed a strict local reduction of T. The 
dual process is a strict local reduction of T° because it is a 
branch-trimming followed by a state-merging. ■ 

Now we can reduce the trellises in Figure 1. 



Example II.3 (cont.) The trellis in Figure 1(b) is span- 
one-uncontrollable. Indeed, the trellis is not branch-trim, and 
deleting the four diagonal branches of the last constraint code 
does not change the code generated by that trellis. Thus, the 
trellis and its dual in Figure 1(a) are locally reducible. Deleting 
those four diagonal branches renders the uncontrollable trellis 



in Figure 2(b). The dual process consist of expanding the last 
constraint code in the trellis in Figure 1(a) by one dimension, 
namely by adding the branch (01|0|01) to the generators of 
this constraint code. This results in the unobservable trellis in 
Figure 2(a), which then is the dual of that in Figure 2(b). 




Figure 2(a) 



Figure 2(b) 



Now we can trim the first trellis at state time 4 to the subspace 
{00,11} and merge the dual state space to F^/jOO, 11}. 
This results in the mutually dual trellises shown in Fig- 
ure 3. These trellises still generate the original code C = 
(OHIO, 10010, 01101) and its dual C^, respectively. Notice 
that they form strict local reductions of the trellises in Figure 1 
in the sense of Definition 11.11 




00 00 00 00 



Figure 3(a) 



Figure 3(b) 



Is is worth emphasizing that the trellis in Figure 1(a) is 
locally reducible, even though it is state-trim, proper, branch- 
trim, observable, controllable, and non-mergeable (i.e., no state 
space can be merged without changing the code generated 
by the trellis). We first had to perform an auxiliary branch- 
addition before a state-trimming resulted in a net reduction of 
the trellis complexity. 

The necessary conditions for local irreducibility we have 
presented so far are not sufficient. For instance, the trellises 
in Figure 3 are state-trim, branch-trim, proper, span-one- 
observable, and span-one-controllable. Yet they are still locally 
reducible, as we will see in the next section. 

IV. Sufficient Condition of Local Irreducibility 

In this section we will present a characterization of local 
irreducibility of tail-biting trellises. For ease of notation, we 
will restrict ourselves to trellis realizations with symbol spaces 
Ai = F for all i. The results can straightforwardly be 
generalized to arbitrary trellises. Following the usual notation, 
all trellises will have length n and thus generate codes in F n . 

Let us return to span-one-unobservable trellises. We have 
the following alternative description. 

Proposition IV.l An observable and controllable trellis is 
span-one-unobservable if and only if there exists a nontrivial 
path of length n—1 representing the zero word (of length n—l). 



Proof: It is clear from the paragraph after Definition III.2 
that a span-one-unobservable trellis must contain such a path. 



Conversely, let T be observable and controllable with behav- 
ior 03, and let T contain a nontrivial path of length n — 1 
representing the zero word. Suppose the path passes through 
the states si, s%, . . . , sq- Replace the constraint code Co by 
Co + ( (so 1 1 si )) . Then the new realization contains 03 and the 
new unobservable trajectory (0, s), where s = (s , . . . , s n _i). 
But since the constraint code increases by just one dimension, 
the behavior can also increase by at most one dimension. 
Thus, the behavior is given by 03 + (0, s), and the new trellis 
still generates the same code. This shows that T is span-one- 
unobservable. ■ 

All of this suggests to extend the notion of span-one- 
observability to longer spans. However, for our purpose 
of local reductions it will suffice to consider span-two- 
observability /controllability. 

Definition IV.2 A trellis realization of length n is called span- 
two-observable if it does not contain a nontrivial path of 
length n — 2 representing the zero word. A trellis is called 
span-two-controllable if its dual is span-two-observable. 

Evidently span-two-observability implies span-one-observa- 
bility implies observability. Span-two-controllability can be 
characterized as follows. 

Proposition IV.3 A trellis is span-two-controllable if and only 
if, for each i E Z m , each pair of states in Si and Si- 2 are 
connected by a path of length n — 2. 

Proof: Without loss of generality let i — 2. Let V be 
the set of all paths in the trellis T starting at time 2 and 
ending at time 0. Then the projection V\s 2 xS is the set of all 
state pairs that are connected by such a path. With the aid of 
projection/cross-section duality one obtains that (V\s 2 xs ) 1 ~ 
is the space of all pairs in S 2 x Sq that are connected by a 
path in T° that represents the zero word. Thus, T° is span- 
two-observable if and only if this space is trivial, which in turn 
is equivalent to V\s 2 xS — $2 X So- This proves the desired 
result. ■ 

Now we can formulate our main result characterizing local 
irreducibility. 

Theorem IV.4 Let C C F" be a code such that both C and C 1 - 
do not contain any codewords that are supported by an interval 
of length at most 2. Let T be a trellis realization ofC. Then the 
following are equivalent. 

(i) T is locally irreducible. 

(ii) T is state-trim, branch-trim, proper, span-two-observable 
and span-two-controllable. 

(Hi) T° is locally irreducible. 

(iv) T° is state-trim, branch-trim, proper, span-two-observable 

and span-two-controllable. 
Furthermore, if T is locally reducible, then it allows either a 
strict local reduction or a local reduction which gives rise to a 
subsequent strict local reduction. In either case, the dual process 
is a reduction of the same type forT°. 



Proof: We have seen already in Theorems III. 1 and III. 3 
that if a trellis is not state-trim, branch-trim, proper, span- 
one-observable/controllable, then it and its dual are locally 
reducible. If a trellis has all these properties, but is not 
span-two-observable, then a local reduction is illustrated in 



Example IV.5 below. The detailed proof can be found in ||4)- 
Let us sketch the proof for (ii) => (i). The remaining 
statements follow easily. Thus, let T be a trellis as in (ii). 
Suppose T is a local reduction of T with state space S\ and 
constraint codes Co and C\, while all other spaces of T and T 
coincide. We have to show that T and T are isomorphic, 
that is, they coincide up to state space isomorphisms. Without 
loss of generality we may assume that T is trim and proper 
at state time 1, and thus at all times. One can easily see 
that T and T° are observable. Let dimSi = dimSi — m 
and dimCi = dim Ci — £i for i = 0, 1, where m, l ,l\ > 0. 



With the aid of Theorem II. 2 one derives straightforwardly 

l0 + £l = TO. 

We show next that i D = i\ = to = 0. To this end, 
let (so,ao,si) € Co- This branch belongs to a valid tra- 
jectory in T, say (a, s). By observability, there is a unique 
valid trajectory (a, s) in T, and thus we obtain a branch 
(so,ao,5i) £ C\. Using properness of T and T, this gives 
rise to a well-defined, injective linear map ipo : Co —> Co, 
(so,ao,Si) H> (so,ao) s 'i)' As a consequence, dim Co > 
dim Co- But then we have equality and ipo is an isomorphism. 
In the same way dimCi = dimCi and there is an isomorphism 
<pi : d -> Ci, (si,ai,s 2 ) Jt> (s",a 1 ,s 2 )- Now l Q + l x = 
implies to = 0, thus dim6>i = dim6>i, and the given local 
reduction is not strict. 

Finally, by Proposition |IV.3| for each s 2 € 6>2 an d 
so € So there exists a path in T starting in s 2 and ending 
in So. As a consequence, each path (s , a , S\, a\, s 2 ) of 
length 2 in T is part of a valid trajectory in T. This in 
turn yields that for each such path (so, <io, s±, 01, s 2 ) there 
exists some si G Si such that <po{so, ao> si) = (soi^dSi) 
and ipi(s%, ax, s 2 ) = (s±,ai,s 2 ). This way we obtain a 
well-defined isomorphism ip : Si — > Si such that Co = 
{(so,ao,tp{si)) I (so,ao,si) £ Co} and similarly for C\. But 
this simply means that T and T are isomorphic trellises. ■ 

Example IV.5 Consider the trellises given in Figure 4 below. 
The trellis in Figure 4(a) is the product trellis of the code C 
generated by 11001 0, 001 110, 100011 with the indicated 
spans. (The code C x does not satisfy the requirements of 



Theorem IV.4 But the example still illustrates the main 
arguments of the general proof; this is due to the fact that 
the reduction is based on span-two-unobservability and not 
span-two-uncontrollability). The trellis is state-trim, branch- 
trim, proper, observable, and controllable. It is also span- 
one-observable and span-one-controllable, but not span-two- 
observable: it contains a path starting at the state 11 € S4, 
ending at 10 £ S 2 , and representing the zero word. This will 
allow us to perform a local reduction by changing the state 
space S3 and its incident constraint codes C 2 , C3. In a first 
step we expand S3 by introducing an additional state, say 



S 3 := S 3 + (s), and expand C 2 and C 3 to C 2 =C 2 + <(10|0|s)> 
and C3 = C3 + ((s|0|ll)). It is not hard to see that the resulting 
trellis, shown in Figure 4(b), still represents the code C. By 
construction, it is unob serva ble and thus can be trimmed as in 
the proof of Theorem 



III.l 



If we trim the state space £3 to 
the subspace (1 + s), we obtain the trellis in Figure 4(c). This 
trellis forms a local reduction of the original trellis where no 
state space and constraint code dimension has changed. But 
the new trellis is obviously not trim, and thus we may trim it 
at state time 4, resulting in the trellis shown in Figure 4(d). 
This illustrates the main idea of the proof of (i) =>■ (ii) in 



Theorem IV.4 one can show that for a span-two-unobservable 
trellis there always exists an extension of one state space 
followed by a trimming that results in a non-trim trellis, which 
then can be further reduced. 

It is easy to see that dualizing the preceding steps leads to 
a two-step local reduction of the dual trellis. 

The trellis in Figure 4(d) is state-trim, branch-trim, proper, 
span-two-observable, span-one-controllable, but not span-two- 
controllable. Thus it can be further locally reduced. 




Figure 4(a) 




Figure 4(b) 




Figure 4(c) 




Figure 4(d) 

In the same manner the trellis in Figure 3(a) can be locally 
reduced. 

V. Summary for tail-biting trellises 
We have given a complete description of tail-biting trellises 



that are locally irreducible in the sense of Definition 1. 1 Our 
methods were solely based on intrinsic trellis properties, and 
no specific representation like the product construction was 
used. Furthermore, we provided constructive procedures of 
how to reduce a given trellis (and its dual). 



Let us compare our results with previous work on tail- 
biting trellises with potentially low complexity. To this end, we 
restrict ourselves again to trellises with symbol spaces A% = F 
for all i. Koetter and Vardy [7| showed that the search for 
possibly minimal linear tail-biting trellis realizations could 
be narrowed to a certain canonical class, which we call 
KV-trellises (here minimal refers to 9-minimal in the sense 
of 0). A KV-trellis is a product realization with dimC linearly 
independent generators, each of which has the shortest circular 
span of any codeword whose span starts (or stops) at the 
same position |3), The construction may be regarded as 
the tail -biting version of the "shortest basis" approach J2). 
KV-trellises are state-trim, branch-trim, proper, observable and 
controllable Q. 

Now we can give an overview of various trellis classes. 
Let us write SIO, S20, SIC, S2C for span-one-observabili- 
ty, span-two-observability, and the dual controllability notions. 
We also denote "state-trim, branch-trim and proper" by T/P, 
and "observable and controllable" by O/C. 

With the machinery developed in [6|, one can show that 
if a code does not contain any span-two codewords, then its 
KV-trellises are S20. Thus, if both the code and its dual do 
not contain any span-two codewords (a requirement that is not 
met by the examples in this note), then their KV-trellises are 
S20 and S2C. On the other hand, there exist examples of T/P 
and S20/S2C trellises that are not KV. All of this leads to the 
following strict containments of classes of tail-biting trellises 
for a given code (assuming that neither the code nor its dual 
contains any span-two codewords): 

{minimal} C {KV} C {T/P, S20/S2C} C {T/P, SIO/SIC} 
C {T/P, O/C}. 

Furthermore, the four trellis classes in the top row are invariant 
under taking duals, whereas the one in the bottom row is 
not. The set {T/P, S20/S2C} is exactly the class of locally 
irreducible trellises. 
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